Text-to-image Diffusion Model in Generative AI: A Survey

This survey reviews text-to-image diffusion models in the context that diffusion models have emerged to be popular for a wide range of generative tasks. As a self-contained work, this survey starts with a brief introduction of how a basic diffusion model works for image synthesis, followed by how condition or guidance improves learning. Based on that, we present a review of state-of-the-art methods on text-conditioned image synthesis, i.e., text-to-image. We further summarize applications beyond text-to-image generation: text-guided creative generation and text-guided image editing. Beyond the progress made so far, we discuss existing challenges and promising future directions.Comment: First survey on the recent progress of text-to-image generation based on the diffusion model (under progress

Robustness of SAM: Segment Anything Under Corruptions and Beyond

Segment anything model (SAM), as the name suggests, is claimed to be capable of cutting out any object. SAM is a vision foundation model which demonstrates impressive zero-shot transfer performance with the guidance of a prompt. However, there is currently a lack of comprehensive evaluation of its robustness performance under various types of corruptions. Prior works show that SAM is biased towards texture (style) rather than shape, motivated by which we start by investigating SAM's robustness against style transfer, which is synthetic corruption. With the effect of corruptions interpreted as a style change, we further evaluate its robustness on 15 common corruptions with 5 severity levels for each real-world corruption. Beyond the corruptions, we further evaluate the SAM robustness on local occlusion and adversarial perturbations. Overall, this work provides a comprehensive empirical study on the robustness of the SAM under corruptions and beyond.Comment: 16page

Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating AT into SSL, multiple prior works have accomplished a highly significant yet challenging task: learning robust representation without labels. A widely used framework is adversarial contrastive learning which couples AT and SSL, and thus constitute a very complex optimization problem. Inspired by the divide-and-conquer philosophy, we conjecture that it might be simplified as well as improved by solving two sub-problems: non-robust SSL and pseudo-supervised AT. This motivation shifts the focus of the task from seeking an optimal integrating strategy for a coupled problem to finding sub-solutions for sub-problems. With this said, this work discards prior practices of directly introducing AT to SSL frameworks and proposed a two-stage framework termed Decoupled Adversarial Contrastive Learning (DeACL). Extensive experimental results demonstrate that our DeACL achieves SOTA self-supervised adversarial robustness while significantly reducing the training time, which validates its effectiveness and efficiency. Moreover, our DeACL constitutes a more explainable solution, and its success also bridges the gap with semi-supervised AT for exploiting unlabeled samples for robust representation learning. The code is publicly accessible at https://github.com/pantheon5100/DeACL.Comment: Accepted by ECCV 2022 oral presentatio

Apexification Management of Mandibular Second Premolar with a Blunderbuss Apex and Periapical Lesion of an Adult Patient

Apexification is widely applied in teenager patients but rarely used in the adult population. Instead, artificial apical barrier with mineral trioxide aggregate (MTA) is clinically accepted, and spontaneous apical closure in nonvital immature teeth of adult patients has rarely been encountered while only apexification of the maxillary incisors in adult patients has been reported. The aim of this case report is to share a successful apexification application in the mandibular premolar with a blunderbuss apex and periapical lesion of an adult patient by using calcium hydroxide: radiographically, spontaneous hard tissue barrier has been established, and narrowing canal space and decreasing area of periapical shadow were documented without complications. Taken together, our study indicates that patient\u27s age and tooth position may not be the critical limitation for apexification. © 2019 Chenshuang Li et al

Isolation and Characterization of Minipig Perivascular Stem Cells for Bone Tissue Engineering

Human subcutaneous adipose tissue has been recognized as a rich source of tissue resident mesenchymal stem/stromal cells (MSC) in recent years. The current study was designed to sort the minipig (mp) perivascular stem cells (PSCs) and investigate the osteogenic potential. Purification of human PSCs was achieved via fluorescence-activated cell sorting (FACS) from human liposuction samples [cluster of differentiation (CD)45-CD34-CD146+ perithelial cells and CD45-CD34+CD146- adventitial cells]. Subsequently, PSCs were isolated from mp adipose tissue samples (n=9), characterized and, using purified mpPSCs (obtained by FACS, which is used in human PSC purification), the mpPSC osteogenic and adipogenic potential was evaluated by Alizarin Red S and Oil Red O staining in vitro, respectively. The cell morphometry was observed following cell isolation and culture, and hematoxylin and eosin staining was performed to identify the fat tissue structure and vascular distribution. Osteogenic and adipogenic differentiation-associated gene expression levels were analyzed by reverse transcription-quantitative polymerase chain reaction. The results demonstrated that the same antigens used for human PSC identification and isolation were working in mp tissue (CD45, CD146 and CD34). The two cell groups: CD45-CD34-CD146+ pericytes and CD45-CD34+CD146- adventitial cells were successfully isolated from the subcutaneous fat in the posterior neck of mps, mpPSCs accounted for 8.6% of the stromal vascular fraction (SVF) with 1.4% pericytes and 7.2% adventitial cells. mpPSCs demonstrated characteristics of MSCs, including cell surface marker expression, colony forming unit-fibroblast inclusion, and the stronger osteogenic and adipogenic differentiation potential than that of the non-selected vascular stromal cells. The mRNA expression levels of osteocalcin, collagen, type I, α1 and peroxisome proliferator-activated receptor-γ in the mpPSCs group were significantly higher than those of the unsorted pSVF group (P\u3c0.05). Thus, the current study successfully isolated and cultured CD146+ and CD34+ cell populations from mp tissues, characterized the cells\u27 PSC-like phenotype and identified their distinctly osteogenic and adipogenic potential. © Spandidos Publications. All rights reserved

Nfatc1 Is a Functional Transcriptional Factor Mediating Nell-1-Induced Runx3 Upregulation in Chondrocytes

Neural EGFL like 1 (Nell-1) is essential for chondrogenic differentiation, maturation, and regeneration. Our previous studies have demonstrated that Nell-1‘s pro-chondrogenic activities are predominantly reliant upon runt-related transcription factor 3 (Runx3)-mediated Indian hedgehog (Ihh) signaling. Here, we identify the nuclear factor of activated T-cells 1 (Nfatc1) as the key transcriptional factor mediating the Nell-1 → Runx3 signal transduction in chondrocytes. Using chromatin immunoprecipitation assay, we were able to determine that Nfatc1 binds to the -833--810 region of the Runx3-promoter in response to Nell-1 treatment. By revealing the Nell-1 → Nfatc1 → Runx3→Ihh cascade, we demonstrate the involvement of Nfatc1, a nuclear factor of activated T-cells, in chondrogenesis, while providing innovative insights into developing a novel therapeutic strategy for cartilage regeneration and other chondrogenesis-related conditions. © 2018 by the authors. Licensee MDPI, Basel, Switzerland

Fibromodulin Reduces Scar Size and Increases Scar Tensile Strength in Normal and Excessive-Mechanical-Loading Porcine Cutaneous Wounds

Hypertrophic scarring is a major postoperative complication which leads to severe disfigurement and dysfunction in patients and usually requires multiple surgical revisions due to its high recurrence rates. Excessive-mechanical-loading across wounds is an important initiator of hypertrophic scarring formation. In this study, we demonstrate that intradermal administration of a single extracellular matrix (ECM) molecule—fibromodulin (FMOD) protein—can significantly reduce scar size, increase tensile strength, and improve dermal collagen architecture organization in the normal and even excessive-mechanical-loading red Duroc pig wound models. Since pig skin is recognized by the Food and Drug Administration as the closest animal equivalent to human skin, and because red Duroc pigs show scarring that closely resembles human proliferative scarring and hypertrophic scarring, FMOD-based technologies hold high translational potential and applicability to human patients suffering from scarring—especially hypertrophic scarring. © 2018 The Authors. Journal of Cellular and Molecular Medicine published by John Wiley & Sons Ltd and Foundation for Cellular and Molecular Medicine

Chondrogenic Regeneration Using Bone Marrow Clots and a Porous Polycaprolactone-Hydroxyapatite Scaffold by Three-Dimensional Printing

Scaffolds play an important role in directing three-dimensional (3D) cartilage regeneration. Our recent study reported the potential advantages of bone marrow clots (MC) in promoting extracellular matrix (ECM) scaffold chondrogenic regeneration. The aim of this study is to build a new scaffold for MC, with improved characteristics in mechanics, shaping, and biodegradability, compared to our previous study. To address this issue, this study prepared a 3D porous polycaprolactone (PCL)-hydroxyapatite (HA) scaffold combined with MC (Group A), while the control group (Group B) utilized a bone marrow stem cell seeded PCL-HA scaffold. The results of in vitro cultures and in vivo implantation demonstrated that although an initial obstruction of nutrient exchange caused by large amounts of fibrin and erythrocytes led to a decrease in the ratio of live cells in Group A, these scaffolds also showed significant improvements in cell adhesion, proliferation, and chondrogenic differentiation with porous recanalization in the later culture, compared to Group B. After 4 weeks of in vivo implantation, Group A scaffolds have a superior performance in DNA content, Sox9 and RunX2 expression, cartilage lacuna-like cell and ECM accumulation, when compared to Group B. Furthermore, Group A scaffold size and mechanics were stable during in vitro and in vivo experiments, unlike the scaffolds in our previous study. Our results suggest that the combination with MC proved to be a highly efficient, reliable, and simple new method that improves the biological performance of 3D PCL-HA scaffold. The MC-PCL-HA scaffold is a candidate for future cartilage regeneration studies.Cell & Tissue EngineeringBiotechnology & Applied MicrobiologyCell BiologySCI(E)[email protected]; [email protected]; [email protected]

Brief Report: Human Perivascular Stem Cells and Nel-Like Protein-1 Synergistically Enhance Spinal Fusion in Osteoporotic Rats

Autologous bone grafts (ABGs) are considered as the gold standard for spinal fusion. However, osteoporotic patients are poor candidates for ABGs due to limited osteogenic stem cell numbers and function of the bone microenvironment. There is a need for stem cell-based spinal fusion of proven efficacy under either osteoporotic or nonosteoporotic conditions. The purpose of this study is to determine the efficacy of human perivascular stem cells (hPSCs), a population of mesenchymal stem cells isolated from adipose tissue, in the presence and absence of NELL-1, an osteogenic protein, for spinal fusion in the osteoporosis. Osteogenic differentiation of hPSCs with and without NELL-1 was tested in vitro. The results indicated that NELL-1 significantly increased the osteogenic potential of hPSCs in both osteoporotic and nonosteoporotic donors. Next, spinal fusion was performed by implanting scaffolds with regular or high doses of hPSCs, with or without NELL-1 in ovariectomized rats (n = 41). Regular doses of hPSCs or NELL-1 achieved the fusion rates of only 20%-37.5% by manual palpation. These regular doses had previously been shown to be effective in nonosteoporotic rat spinal fusion. Remarkably, the high dose of hPSCs+NELL-1 significantly improved the fusion rates among osteoporotic rats up to approximately 83.3%. Microcomputed tomography imaging and quantification further confirmed solid bony fusion with high dose hPSCs+NELL-1. Finally, histologically, direct in situ involvement of hPSCs in ossification was shown using undecalcified samples. To conclude, hPSCs combined with NELL-1 synergistically enhances spinal fusion in osteoporotic rats and has great potential as a novel therapeutic strategy for osteoporotic patients. © 2015 AlphaMed Press

Neural EGFL-Like 1 Is a Downstream Regulator of Runt-Related Transcription Factor 2 in Chondrogenic Differentiation and Maturation

Recent studies indicate that neural EGFL-like 1 (Nell-1), a secretive extracellular matrix molecule, is involved in chondrogenic differentiation. Herein, we demonstrated that Nell-1 serves as a key downstream target of runt-related transcription factor 2 (Runx2), a central regulator of chondrogenesis. Unlike in osteoblast lineage cells where Nell-1 and Runx2 demonstrate mutual regulation, further studies in chondrocytes revealed that Runx2 tightly regulates the expression of Nell-1; however, Nell-1 does not alter the expression of Runx2. More important, Nell-1 administration partially restored Runx2 deficiency–induced impairment of chondrocyte differentiation and maturation in vitro, ex vivo, and in vivo. Mechanistically, although the expression of Nell-1 is highly reliant on Runx2, the prochondrogenic function of Nell-1 persisted in Runx2−/− scenarios. The biopotency of Nell-1 is independent of the nuclear import and DNA binding functions of Runx2 during chondrogenesis. Nell-1 is a key functional mediator of chondrogenesis, thus opening up new possibilities for the application of Nell-1 in cartilage regeneration. © 2017 American Society for Investigative Patholog